Video based rendering of planar dynamic scenes
نویسندگان
چکیده
In this paper, we propose a method to synthesize arbitrary views of a planar scene from a monocular video sequence of it. The 3D direction of motion of the object is robustly estimated from the video sequence. Given this direction any other view of the object can be synthesized through a perspective projection approach, under assumptions of planarity. If the distance of the object from the camera is large, a planar approximation is reasonable even for nonplanar scenes. Such a method has many important applications, one of them being gait recognition where a side view of the person is required. Our method can be used to synthesize the side-view of the person in case he/she does not present a side view to the camera. Since the planarity assumption is often an approximation, the effects of non-planarity can lead to inaccuracies in rendering and needs to be corrected for. Regions where this happens are examined and a simple technique based on weak perspective approximation is proposed to offset rendering inaccuracies. Examples of synthesized views using our method and performance evaluation are presented.
منابع مشابه
Real-Time Video-Based Modeling and Rendering of 3D Scenes
virtual reality, developing techniques for synthesizing arbitrary views has become an important technical issue. Given an object’s structural model (such as a polygon or volume model), it’s relatively easy to synthesize arbitrary views. Generating a structural model of an object, however, isn’t necessarily easy. For this reason, research has been progressing on a technique called image-based mo...
متن کاملFast Incident Light Field Acquisition and Rendering
We present a practical and inexpensive approach for the acquisition and rendering of static incident light fields. Incident light fields can be used for lighting virtual scenes or to insert virtual objects into real world video footage. The virtual objects are correctly lit and cast shadows in the same way as real objects in the scene. We propose to use an inexpensive planar mirror and a high d...
متن کاملModelling and Rendering of Realistic Waterfall Scenes with Dynamic Texture Sprites1.dvi
We propose an efficient approach for authoring dynamic and realistic waterfall scenes based on acquired video sequence. Traditional video based techniques generate new images by synthesizing 2D samples, i.e., texture sprites chosen from video sequence. However, they are limited to one fixed viewpoint and cannot provide arbitrary walkthrough into 3D scenes. Our approach extends this scheme by sy...
متن کامل3D Scene Reconstruction System from Multiple Synchronized Video Images
One of the goals of three-dimensional (3D) computer graphics is to create virtual realistic images of dynamically changing scenes. In this paper, we designed and implemented a system that processes multiple synchronized video sequences and generates 3D rendering of dynamic objects in real time. The videoimage-based virtual volumetric scene reconstruction system acquires synchronized multiple vi...
متن کاملPlanelet Transform: A New Geometrical Wavelet for Compression of Kinect-like Depth Images
With the advent of cheap indoor RGB-D sensors, proper representation of piecewise planar depth images is crucial toward an effective compression method. Although there exist geometrical wavelets for optimal representation of piecewise constant and piecewise linear images (i.e. wedgelets and platelets), an adaptation to piecewise linear fractional functions which correspond to depth variation ov...
متن کامل